🕷️️ Job Radar • SCRAPING

upwork.com 2026-04-24 🟢

🔹 Refactor raw job descriptions into a structured Technical Manifest (JSON)
👤 Client: 🇩🇪 Germany Member since 2020-10-20
💰 Price: ****
🚩 Problem: Ensure 100% accuracy in data extraction and publication of affiliate program details.
📦 Existing: [Current Tech] Existing backend system for storing and managing affiliate programs. [Format] JSON format is used for current entries.

Specifications:

[Target] Extract and input structured data from official sources into the backend system.
[Method] Use web scraping tools to gather data, cross-reference with primary sources, and validate information before entry.
[UI/UX] Not applicable as this is a backend task. Focus on accuracy and structure of JSON entries.
[Stack] Python (for scraping), BeautifulSoup, Requests library, JSON for data storage.
[Security] Ensure all data handling complies with GDPR and other relevant regulations. Implement secure data transfer methods.
[Format] Refactor raw text into structured JSON format: {commission_type, commission_rate, cookie_duration, payout_structure, approval_process, affiliate_network}

Workflow:

1. Identify official sources for each affiliate program (websites, API endpoints).
2. Use web scraping tools to extract relevant data points.
3. Cross-reference extracted data with primary sources and verify accuracy.
4. Structure the verified data into JSON format as specified.
5. Input structured JSON data into the backend system.
6. Review and approve user-submitted affiliate programs for consistency and accuracy.